A Regression Paradox for Linear Models: Sufficient Conditions and Relation to Simpsons Paradox
نویسندگان
چکیده
An analysis of customer survey data using direct and reverse linear regression leads to inconsistent conclusions with respect to the effect of a group variable. This counterintuitive phenomenon, called the “regression paradox,” causes seemingly contradictory group effects when the predictor and regressand are interchanged. Using analytical developments as well as geometric arguments, we describe sufficient conditions under which the regression paradox will appear in linear Gaussian models. The results show that the phenomenon depends on a distribution shift between the groups relative to the predictability of the model. As a consequence, the paradox can appear naturally in certain distributions, and may not be caused by sampling error or incorrectly specified models. Simulations verify that the paradox may appear in more general, non-Gaussian settings. An interesting, geometric connection to Simpson’s paradox is provided.
منابع مشابه
Bertrand’s Paradox Revisited: More Lessons about that Ambiguous Word, Random
The Bertrand paradox question is: “Consider a unit-radius circle for which the length of a side of an inscribed equilateral triangle equals 3 . Determine the probability that the length of a ‘random’ chord of a unit-radius circle has length greater than 3 .” Bertrand derived three different ‘correct’ answers, the correctness depending on interpretation of the word, random. Here we employ geomet...
متن کاملThe Transportation Paradox Revisited
The transportation paradox is related to the classical transportation problem. For certain instances of this problem an increase in the amount of goods to be transported may lead to a decrease in the optimal total transportation cost. Thus this phenomenon has also been named the more-for-less-paradox. Even though the paradox has been known since the early days of linear programming, it has got ...
متن کاملParadox in the Poetry of Hazin-e Lahiji
Paradox is one of the literary techniques in the poetry of the Safavid poets. Hazin-e Lahiji, like so many other poets of that age, employed this technique in his pursuit and showed that "unfamiliar meaning". Paradox is used in the poetry of Hazin-e Lahiji for the purpose of defamiliarization and exoticism. The poet in order to create new implications and subtle and insightful points and also t...
متن کاملNew Approach in Fitting Linear Regression Models with the Aim of Improving Accuracy and Power
The main contribution of this work lies in challenging the common practice of inferential statistics in the realm of simple linear regression for attaining a higher degree of accuracy when multiple observations are available, at least, at one level of the regressor variable. We derive sufficient conditions under which one can improve the accuracy of the interval estimations at quite affordable ...
متن کاملThe Paradox of Health Policy: Revealing the True Colours of This ‘Chameleon Concept’; Comment on “The Politics and Analytics of Health Policy”
Health policy has been termed a ‘chameleon concept’, referring to its ability to take on different forms of disciplinarity as well as different roles and functions. This paper extends Paton’s analysis by exploring the paradox of health policy as a field of academic inquiry—sitting across many of the boundaries of social science but also marginalised by them. It situates contemporary approaches ...
متن کامل